French AI startup Mistral AI has officially launched a new content moderation API aimed at competing with OpenAI and other industry leaders, while addressing the growing concerns around AI safety and content filtering. This service is based on Mistral's Ministral8B model, finely tuned to detect potential harmful content across nine different categories, including pornography, hate speech, violence, dangerous activities, and personally identifiable information.

Recently, U.S. officials announced that a global Artificial Intelligence (AI) Safety Summit will be hosted in San Francisco in November. As AI technology advances rapidly, governments around the world are striving to keep pace with this change. The summit will be co-chaired by U.S. Secretary of Commerce Gina Raimondo and Secretary of State Antony Blinken, and is scheduled for November 20-21. Raimondo stated in a release, 'As AI develops rapidly, we are doing everything we can.' She noted the importance of close international collaboration and thoughtful coordination.

Recently, OpenAI's CEO Sam Altman announced his decision to leave the company's internal safety committee, which was established in May of this year to oversee key safety and security decisions in the development and deployment of OpenAI's AI models. Altman's decision has drawn significant attention as he hopes to hand this role over to third-party experts to enhance transparency, collaboration, and security. With Altman's departure, this safety committee will transform into an 'independent oversight committee' focused on safety and security issues.

The United States, the United Kingdom, and the European Union have jointly signed the first legally binding AI treaty, the 'AI Framework Convention', aimed at ensuring that AI applications adhere to principles of human rights, democracy, and the rule of law. The treaty requires signatory countries to follow principles that protect user data, respect the law, and operate transparently, implementing these principles through legislation and administrative measures. Although compliance with the treaty primarily relies on monitoring, and enforcement may be weak, it is seen as an important blueprint for countries to formulate AI laws. Currently, the US, EU, UK, and several other countries have signed, and the treaty will come into force in five...

California lawmakers have passed the SB1047 bill aimed at ensuring AI safety, which is set to be signed by Governor Gavin Newsom. The bill requires AI models with training costs exceeding $100 million to undergo safety testing before release and establishes an emergency stop function in case of accidents. It also mandates reporting to the California Attorney General within 72 hours of an incident and establishes a 'Cutting-edge Model Bureau' to oversee compliance, with substantial fines for violators. This initiative aims to prevent AI misuse, ensure safety, and has garnered support from notable figures in the AI field. However, tech giants have had mixed reactions.

Musk publicly supports California's SB1047 bill, which aims to require large AI model manufacturers to implement safeguards against potential harms. The bill mandates documentation of strategies to prevent serious damage caused by AI. Musk underscores the necessity of AI regulation, consistent with his past concerns about AI risks. His AI company, xAI, will be bound by the SB1047 bill. In contrast, OpenAI opposes the SB1047 bill and supports an alternative proposal. This event highlights the complexity and controversy of AI regulation within the industry.

Musk supports California's SB1047 bill, which requires large AI model development companies to document safety measures to prevent models from causing serious harm. He emphasized that he has always advocated for AI regulation, believing it should be treated like the regulation of risky products and technologies. Musk's company xAI will be bound by this law, even though he plans to leave California. In contrast, OpenAI openly opposes SB1047 and supports an alternative bill. Adobe and Microsoft, on the other hand, support another new California bill AB3211, which requires labeling of AI-generated content. These developments highlight the dynamic landscape of AI regulation.

OpenAI and several tech companies oppose a California bill aimed at ensuring the safety and transparency of artificial intelligence, fearing that it will hinder innovation and development in AI technology, potentially leading to an outflow of the industry. OpenAI stated in a press release that overly strict regulations could stifle the creativity of developers and researchers, limiting exploration and experimentation. They emphasized that technological innovation requires flexibility rather than being constrained by legal limitations. OpenAI hopes to engage in dialogue with lawmakers to promote a more reasonable legal framework that aligns with industry development trends. If the bill passes, it could lead to...

Anthropic has announced an expansion of its vulnerability reward program aimed at testing a 'next-generation AI safety mitigation system,' primarily focusing on identifying and defending against 'universal jailbreak attacks.' Special attention is given to high-risk areas, including CBRN defense and cybersecurity. Participants will have the opportunity to engage with the new safety system ahead of time, identifying vulnerabilities or bypassing security measures, with rewards of up to $15,000. This initiative aims to enhance the safety of AI systems by attracting security researchers to collaboratively discover and fix potential threats, setting a benchmark for safety in the AI industry.

OpenAI CEO Sam Altman announced that OpenAI will provide early access to its new generative AI model for safety testing by the U.S. AI Safety Institute. This decision aims to counter accusations of neglecting safety in AI development, following criticism for disbanding a team focused on AI safety measures. In response to concerns, OpenAI pledged to allocate 20% more computing resources to safety research and removed non-disparagement clauses for ....

Recently, OpenAI supported three key AI legislations in Congress aimed at influencing the federal government's policy on artificial intelligence. These bills include the 'Future AI Innovation Act', which seeks to establish a U.S. AI Safety Institute as a federal agency for developing standards and guidelines for AI models; the 'National Science Foundation AI Education Act', which provides federal scholarships for AI research and establishes AI educational resources within the education system; and the 'Create AI Act', designed to minimize risks associated with new technologies. OpenAI's move not only demonstrates its commitment to...

Apple has joined the U.S. government's voluntary AI safety commitment, seen as a key step toward promoting responsible innovation in AI. The commitment announced by the White House includes transparency about AI capabilities and labeling AI-generated content, aimed at reducing misinformation and safety risks associated with advancements in AI technology. Federal agencies have completed actions related to AI safety, focusing on risk management, attracting talent, and enhancing global leadership in AI. Apple's new AI features are facing delays, originally planned for release in the September system update, now set to be postponed by at least a few weeks. Developers will have an early experience with Apple's new A.

US Senators have written to OpenAI CEO Sam Altman requesting the company to disclose details of its safety measures and working conditions by August 13, 2024. This comes in the wake of media reports highlighting potential safety risks and employee turnover issues. Senators are particularly concerned about safety issues arising from OpenAI's accelerated testing of new models like GPT-4, emphasizing the need for public trust in the company's capabilities in safety, commitment enforcement, and cybersecurity policies. OpenAI has issued a statement via social media acknowledging these concerns and stating that it has implemented measures including the establishment of a safety and security committee.

OpenAI announced an internal restructuring plan this Tuesday. According to a post by the company's CEO, Sam Altman, on the social media platform X, Aleksander Madry, the former head of AI safety, has been reassigned to a new role focused on AI reasoning.Altman praised Madry's work in a tweet, stating that he is "working on a new, very important research project." This move not only acknowledges Madry's capabilities but also underscores OpenAI's commitment to research in the field of AI reasoning

Anthropic has launched the Claude3 series, with a strong focus on safety. Claude3 surpasses GPT-4 and Gemini1.0Ultra in multiple domains. It utilizes 'Constitutional AI' training techniques, emphasizing safety. Anthropic has received significant investments to expand its functionalities and services.

Some legal experts believe that AI outputs should be protected under the First Amendment. Legal expert Peter Salib warns that this viewpoint could have serious consequences. Regulation of AI outputs may face challenges, leading to potential dangers. Salib advocates for regulations specifically on AI outputs to mitigate risks.

["Google Brain co-founder Andrew Ng conducted an experiment to attempt to make GPT-4 execute a fatal task.", "The experimental results showed that ChatGPT was not successfully manipulated, and Ng stated that a catastrophic scenario was not triggered.", "Ng emphasized that current AI systems are relatively safe, and concerns about the potential dangers of future AI are unrealistic.", "There is a divergence of opinions regarding the future of AI; Ng is optimistic about current technology and emphasized that as AI safety research advances, technology will become more secure."]

["OpenAI has developed a plan to address the serious risks posed by AI","The framework includes a risk scorecard, assessments, and predictions of potential harms","Hiring a team of experts to monitor technologies and warn of dangers","Recruiting national security experts to address significant risks","Allowing independent third parties to test its technology"]